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CAMERA 

BACKGROUND OF THE INVENTION 

Field of the Tnvention 

The present invention relates to a camera, particularly to a camera which can store 
5 both image data and audio data in a storage medium. 

Description of the Related Art 

Japanese Patent Application Laid-open No. 7-154734 discloses a digital still camera, 
which can record not only a still image but also a moving image in a memory card, and can 
record audio captured by a microphone at the same time. 
10 However, in case little audio was recorded (for example, a landscape was shot) or 

audio was not recorded, the reproduction of the image is dull. 



SUMMARY OF THE FNVF.NTTON 

The present invention has been developed in view of the above-described 
circumstances, and has as its object the provision of a camera in which reproduction of a 

15 recorded image is enjoyable. 

In order to achieve the above-described objects, the present invention is directed to a 
camera comprising: an image data storing device that stores image data captured by an 
imaging device in a first storage medium; an audio data obtaining device that obtains audio 
data from one of the first storage medium and a second storage medium; and an audio data 

20 storing device that records in the first storage medium the audio data obtained by the audio 
data obtaining device when the image data storing device stores the image data in the first 
storage medium. 

The present invention is also directed to a camera comprising: an image data storing 
device that stores image data captured by an imaging device in a first storage medium; an 
25 audio data obtaining device that obtains audio data from one of the first storage medium and a 
second storage medium; and an audio data storing device that selectively records in the first 
storage medium one of the audio data obtained by the audio data obtaining device and audio 
data captured by a microphone when the image data storing device stores the image data in the 
first storage medium. 
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The present invention is also directed to a camera comprising: an image data storing 
device that stores image data captured by an imaging device in a first storage medium; an 
audio data obtaining device that obtains audio data from one of the first storage medium and a 
second storage medium; and an audio data storing device that mixes the audio data obtained 
5 by the audio data obtaining device and audio data captured by a microphone when the image 
data storing device stores the image data in the first storage medium, and records the mixed 
audio data in the first storage medium. 

The image data captured by the imaging device is desirably moving image data. 

The camera may further comprise two mounting parts to which the first storage 
10 medium and the second storage medium are attached. 

The second storage medium may be built in the camera. 

The second storage medium may be a rewritable storage medium. 

The camera may further comprise an audio reproducing device that reproduces audio 
recorded in one of the first storage medium and the second storage medium. 
15 According to the present invention, the audio data of music or the like is obtained 

from the storage medium and stored with the image data. Therefore, the present invention is 
effective in a case where little audio is recorded (for example, a landscape is shot) or audio is 
not recorded, and thus the reproduction of the image can be enjoyable due to the audio from 
the storage medium. Moreover, since audio such as background music can be mixed with the 
20 audio from the microphone at the shooting, time-consuming audio editing after the shooting 
can be eliminated. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The nature of this invention, as well as other objects and advantages thereof, will be 
explained in the following with reference to the accompanying drawings, in which like 
25 reference characters designate the same or similar parts throughout the figures and wherein: 
Fig. 1 is a block diagram showing a structure of a digital still camera to which the 
present invention is applied; and 

Fig. 2 is a flowchart showing an order of process when recording a moving image. 
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DETAILED DESCRTPTTON OF THE PREFERRED EMBODIMENTS 

Hereunder a preferred embodiment will be described of a camera of the present 
invention in accordance with the accompanying drawings. 

Fig. 1 is a block diagram showing a structure of a digital still camera to which the 
5 present invention is applied. The digital still camera which is constructed as shown in Fig. 1 
can record and reproduce not only a still image but also a moving image. The digital still 
camera can obtain audio data from a microphone 22 at the same time, and can record the audio 
data in an image memory card 40 with the image data. Moreover, a mixture of audio data of 
background music or the like and the audio data obtained from the microphone 22 can be 
10 stored with the image data, or audio data of background music or the like can be stored with 
the image data instead of the audio data obtained from the microphone 22. Further, the 
camera serves as a reproducing apparatus that reproduces only audio such as music. 

Keys are provided to the camera. A user operates the keys in order to give 
respective instructions such as mode setting (a record mode, a play mode, etc.) and releasing 
15 of a shutter, from a key inputting part 36 to a CPU 34 in Fig. 1 . The CPU 34 controls circuits 
according to inputs from the key inputting part 36. 

When the record mode for recording a moving image or a still image is set, an 
imaging device (CCD) 10 starts a recording processing, and converts, using respective light 
receiving sensors, a subject image formed on a light receiving surface into a signal charge 
20 corresponding with an amount of light which has entered. The signal charge of the respective 
light receiving sensors is successively outputted from the imaging device 10 as a voltage 
signal which corresponds with the amount of the signal charge. 

The voltage signal outputted from the imaging device 10 is processed through a 
coefficient double sampling (CDS) and a color separation into the respective R, G, and B 
25 signals by the preamplifier 12, and adjustment of the signal levels of the respective color 
signals is executed (pre-white balance). 

The respective color signals outputted from the preamplifier 12 are converted into R, 
G, and B digital signals by an A/D converter 14, and are inputted in an image signal 
processing part 16. 

30 The R, G, and B digital signals inputted in the image signal processing part 16 are 

now converted into brightness signals and color difference signals and at the same time a 



4 



predetermined process such as a gamma correction is executed; whereby, image data in a 
predetermined format is produced. 

The image signal processing part 16 can record both a moving image and a still image. 
When a release switch is pressed in a record mode for a moving image, the image signal 

5 processing part 16 compresses the image data produced as described above in a format such as 
the motion JPEG while the release switch is being pressed, and records the compressed image 
data in the image memory card 40 in an order. If the release switch is pressed in a record 
mode for a still image, the image data of one frame at the time the release switch is pressed is 
compressed in the JPEG format, and the image data thus compressed is recorded in the image 

10 memory card 40. A predetermined file name is assigned to the image data of a sequence of 
the moving image, or the image data of the still image of one frame, and the image data are 
identifiable by the file names. 

The image memory card 40 can be inserted in an image slot which is provided to the 
camera, and the memory card itself is not limited to recording images only. Well-known 

15 memory cards are a smart media, a PC card, and so forth, but the memory cards are not limited 
only to them. A form of a memory card does not have to be a card, and a storage medium of 
any form may be used (this is true for a music memory card 42 which will be described below 
as well). Formats for image data compressing are not limited only to the motion JPEG and 
the JPEG, and other formats (e.g. the MPEG) are allowed to use. 

20 Separated from the above-described image data recording process, the image signal 

processing part 16 outputs the image data before being compressed to a D/A converter 18. 
The image data outputted from the image signal processing part 16 is converted into analog 
signals by the D/A converter 1 8, then is inputted in an encoder 20. After that, the converted 
image data is further converted into color composite video signals in the NTSC format, and is 

25 outputted as video signals from a video outputting terminal. When connecting external 

equipment such as a monitor and a personal computer to the video outputting terminal, video 
signals being taken by the camera are transferred to the external equipment. 

Next, a description will be given of a reproducing process of the image data in a case 
where the camera is set at a play mode by an input from the key inputting part 36. When the 

30 user designates a file to be reproduced from the key inputting part 36, the CPU 34 instructs to 
the image signal processing part 1 6 to reproduce the image data of the file. The image signal 
processing part 16 reads out image data of the file from the image memory card 40, and 



recovers the image data before being expanded and compressed. Likewise, the image data is 
outputted as video signals via the D/A converter 1 8 and the encoder 20. 

Now, a description will be given of a recording process for the audio data. In the 
record mode of the moving image, the recording process for the audio data is executed at the 
5 same time as the recording process for the above-mentioned image data. When the record 
mode for the moving image is set, the microphone 22 detects the audio and converts the audio 
into an electric signal. The audio signal is amplified by an amplifier 24 and is converted into 
a digital signal by the AJD converter 26, then is inputted in the audio signal processing part 28 
as the audio data. 

10 When pressing the release switch, the CPU 34 instructs the audio signal processing 

part 28 to execute an audio data recording process. By the instruction, the audio signal 
processing part 28 compresses the audio data obtained from the microphone 22 into a 
predetermined format such as the MP3 . Then, the compressed audio data is recorded in the 
image memory card 40 by corresponding the audio data with the image data of the same time, 

15 while the image data of the moving image is recorded in the image memory card 40 in an 

order. In addition, the audio data is recorded in the same file as the corresponding image data 
in the motion JPEG format; however, the corresponding between the image data with the audio 
data may be done by any methods. 

In the camera, the audio data obtained from the microphone 22 as described above is 

20 recorded in the image memory card 40 by an input from the key inputting part 36, and also the 
audio data of music recorded in a music memory card 42 beforehand which is different from 
the image memory card 40 is recorded in the image memory card 44 by mixing the music 
audio data with the audio data obtained from the microphone 22, or the music audio data is 
recorded instead of the audio data obtained from the microphone 22. In addition, two slots, 

25 an image slot and a music slot, are provided to the camera, and the music memory card 42 is 
inserted in the music slot. The audio data to be recorded in the memory card 42 beforehand 
is not limited to music and may be desired audio data, but in view of a standard use, the audio 
data is music audio data. 

A ratio between the audio data obtained from the music memory card 42 and the 

30 audio data obtained from the microphone 22 when mixing these audio data, that is, a mixing 
ratio, can be set at any value by the user who inputs from the key inputting part 36. 
Moreover, only the audio data obtained from the music memory card 42 can be recorded in the 
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image memory card 40 by completely excluding the audio data obtained from the microphone 
22. 

In a case where files (tunes) of a plurality of types are recorded in the music memory 
card 42, the user can freely select any file by designating a file name from the key inputting 
5 part 36. 

The audio signal processing part 28 is provided setting contents such as the mixing 
ratio mentioned above from the CPU 34, and the audio signal processing part 28 executes 
processing in accordance with the setting contents. More specifically, the audio signal 
processing part 28 obtains the audio data from the microphone 22 in the same manner as 

10 described above, and at the same time reads out the audio data of the file designated from the 
music memory card 42. If the audio data recorded in the music memory card 42 is 
compressed in a format such as the MP3, the audio data is expanded for the time being. 
After that, the audio data obtained from the microphone and the audio data obtained from the 
music memory card 42 are mixed at a designated mixing ratio. The audio data thereby mixed 

15 is compressed, and then is recorded in the image memory card 40 by corresponding the audio 
data with the image data at the time the moving image data is recorded in the image memory 
card in an order. In a case where only the audio data obtained from the music memory card 
42 is recorded in the image memory card 40 instead of the audio data obtained from the 
microphone 22, the compressed audio data can be directly transferred from the music memory 

20 card 42 to the image memory card 40 if the compression format of the audio data is the same 
as the format for recording the audio data in the image memory card 40. 

A description will now be given of a reproducing process for the audio data. The 
reproducing process for the audio data is executed at the same time as the reproducing process 
of the image data mentioned above in the play mode. When reproducing of a file of the 

25 moving image is designated in the play mode, the CPU 34 gives an instruction to the audio 

signal processing part 28 to reproduce the audio data. The audio processing part 28 reads out 
from the image memory card 40 the audio data which corresponds with the image data read 
out by the image signal processing part 16 from the image memory card 40, and expands the 
read out audio data, then recovers the audio data before being compressed. The recovered 

30 audio data is outputted to the D/A converter 30, converted into analog signals, and amplified 
by the amplifier 32, then is outputted as audio signals from the audio output terminal. When 
connecting the external equipment such as a monitor and a personal computer with the audio 
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output terminal, the audio signal as well as the image signal outputted from the video output 
terminal can be transferred to the external equipment. 

In the camera of the present invention, when the music play mode is set by an input 
from the key inputting part 36, only the audio data such as music recorded in the music 
5 memory card 42 can be reproduced regardless of reproducing of the image data. In short, the 
camera of the present invention can be used as a solid audio. When the user designates a file 
to be reproduced from the key inputting part 36 in the music play mode, the CPU instructs the 
audio signal processing part 28 to reproduce the audio data of the file. The audio signal 
processing part 28 reads out the audio data of the file designated from the music memory card 

10 42, and outputs the audio data as audio signal via the D/A converter 30 and the amplifier 32 in 
the same manner as described above. In the camera, not only music reproducing, but also the 
audio data can be inputted from the external equipment, so that only the audio data can be 
recorded in the music memory card 42 regardless of recording of the image data. 

A description directed to a process order for recording the moving image will be 

15 given with reference to the flowchart of Fig. 2. First, the CPU 34 determines whether or not 
an input from the key inputting part 36 sets a record mode for the moving image (Step SI 0). 
For example, if the determination is NO due to the play mode, "no recording" is determined 
(Step S12), and the CPU 34 waits the next input. 

On the other hand, if the CPU 34 determines the record mode for the moving image at 

20 Step S10, the CPU 34 then determines whether or not the image memory card 40 is inserted in 
the image slot (Step SI 4). If the determination is NO, "no recording" is determined in the 
same manner as described above, and the CPU waits the next input. At Step S 14, if the CPU 
34 determines that the image memory card 40 is inserted in the image slot, the CPU 34 then 
determines whether or not the music memory card 42 is inserted in the music slot (Step SI 6). 

25 If the determination is NO, the CPU 34 determines that the audio data recorded in the image 
memory card 40 with the image data is the audio data only which is obtained from the 
microphone 22. In other words, when pressing the release switch (Step S 1 8), the image data 
obtained from the imaging device 10 and the audio data obtained from the microphone 22 are 
recorded in the image memory card 40 (Step S20). 

30 If the determination at Step S 1 6 is YES, that is, if the music memory card 42 is 

inserted in the music slot, the CPU 34 then determines whether or not the input from the key 
inputting part 36 is set at background music present (Step S22). If the determination is NO, 
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when pressing the release button (Step SI 8), the image data obtained from the imaging device 
10 and the audio data obtained from the microphone 22 are recorded in the image memory 
card 40 (Step S20). 

If the determination at Step S22 is YES, that is, if the input is set at the background 
5 music present, a tune is selected (file selection) in accordance with an input from the key 

inputting part 36 (Step S24). Continuously, the mixing ratio between the audio data from the 
microphone 22 and the audio data (music) from the music memory card 42 is determined in 
accordance with an input from the key inputting part 36 (Step S26). When the release switch 
is pressed after the completion of the above settings in the same manner (Step S28), the CPU 

10 34 reads out the audio data of the selected tune which is selected from the music memory card 
42 and at the same time obtains the audio data from the microphone 22, then produces mixed 
audio data in which the audio data is mixed at the mixing ratio. After that, the audio data is 
recorded in the image memory card 40 with the image data obtained from the imaging device 
10 by corresponding the audio data with the image data. 

15 In the present embodiment, a description has been given of a case where the audio 

data is recorded by corresponding the audio data with the image data for the moving image; 
however, the present invention can be applied in the same manner as described above for the 
moving image, if the audio data can be recorded by corresponding the audio data with the 
image data for the still image. 

20 In the present embodiment, the image slot to which the image memory card 40 is 

attached and the music slot to which the music memory card 42 is attached are provided 
respectively for the exclusive use; however, the use of each slot is not limited only to image or 
music when providing such two slots. When the music memory card 42 is not used, both 
slots can be used as image slots, and when the image memory card 40 is not used, both slots 

25 can be used as music slots. For example, two slots may be used for editing such as 
duplication of a file. 

In the present embodiment described above, a description has been given of a case 
where two slots are provided to which the image memory card 40 and the music memory card 
42 are respectively attached; however, two slots are not always required, and the above- 
30 described processes may be performed with only one slot. 

For example, the music memory card 42 is inserted in the slot before the recording so 
as to obtain necessary audio data from the music memory card 42, and the audio data is stored 
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in an inner memory. After completion of the process, the music memory card 42 is taken out 
from the slot and the image memory card 40 is inserted in the slot. Therefore, the audio data 
such as music which is stored in the inner memory of the camera can be recorded in the image 
memory card 40 by mixing the audio data with the audio data obtained from the microphone 

5 22, or can be recorded instead of the audio data. 

In the present embodiment, the audio data such as music is recorded in the music 
memory card 42. However, the audio data such as music provided by a maker is stored in a 
non-volatile memory in the camera beforehand, and by using the audio data, the music 
memory card 42 and the music slot can be eliminated. Likewise, while the audio data such as 

10 music is stored in the non- volatile memory in the camera beforehand, the audio data stored in 
the non-volatile memory may be updated. A method for updating the audio data in that case 
can be achieved by attaching the memory card, in which the audio data for updating is 
recorded, to the slot, or by transferring the audio data from the external equipment by the input. 
Moreover, the audio data such as music is recorded beforehand in a format (folder name and 

1 5 an extension) which can be distinguished from the image data, and the audio data being mixed 
with the audio data obtained from the microphone 22 may be read out from the image memory 
card 40. 

Further, in the present embodiment, the audio data obtained from the microphone 22 

and the audio data obtained from the music memory card 42 can be mixed at a desired mixing 
20 ratio; however the present invention is not limited to that. One of the audio data obtained 

from the microphone 22 and the audio data obtained from the music memory card 42 may 

simply be selected to be recorded. 

Furthermore, in the present embodiment, the present invention is applied to a digital 

still camera; however, the camera is not limited to the digital still camera. The present 
25 invention can be applied to a camera which has a function to record image and audio (such as 

a video camera) at the same time. 

As described above, according to the camera of the present invention, the audio data 

of music or the like is obtained from the storage medium and stored with the image data. 

Therefore, the present invention is effective in a case where little audio is recorded (for 
30 example, a landscape is shot) or audio is not recorded, and thus the reproduction of the image 

can be enjoyable due to the audio from the storage medium. Moreover, since audio such as 

background music can be mixed with the audio from the microphone at the shooting, time- 
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consuming audio editing after the shooting can be eliminated. 

It should be understood, however, that there is no intention to limit the invention to 
the specific forms disclosed, but on the contrary, the invention is to cover all modifications, 
alternate constructions and equivalents falling within the spirit and scope of the invention as 
expressed in the appended claims. 



